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(54) DEVICE FOR CONCEALING DEFECTIVE PIXEL OF IMAGING DEVICE 



(57)Abstract: 

PROBLEM TO BE SOLVED: To obtain a defective pixel concealing device to 
properly correct the values of defective pixels even when a plurality of defective 
cells are continuously generated in an imaging device. 

SOLUTION: When pieces of image data picked up by the imaging device (CCD) 
12 and converted into a digital signal at an analog/digital converting part 18 are 
supplied to a digital signal processing part 20 provided in a digital camera 10, 
these pieces of data are stored in a frame memory(FM) 21. When positional 
information 114 in which pieces of coordinate data indicating the defective pixels 
of the imaging device 12 which are stored in a coordinate memory 28 are 
supplied to the signal processing part 20 from a control part 22, pixels adjacent 
to object pixels are judged whether they are defective in the case of performing 
interpolation processing of object pixels indicated by the position information 1 14, 
defective adjacent pixels are not used, the pixel values of normal adjacent pixels 
are adopted, the average of them are calculated, written in storage addresses of 



the object pixels and the pixel values of the defective pixels being the object of 
processing are interpolated. 
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1 .This document has been translated by computer. So the translation may not 

reflect the original precisely. 

2.**** shows the word which can not be translated. 

3. In the drawings, any words are not translated. 

CLAIMS 
[Claim(s)] 

[Claim 1] In the defect pixel compensator of the image sensor which inputs the 
pixel signal outputted from an image sensor, and amends the defect pixel value 
of said pixel signal by the defect pixel in this image sensor this equipment A 
signal storage means to memorize said pixel signal to a predetermined storage 
region, and a defective coordinate acquisition means by which the pixel signal 
corresponding to the defect pixel in said image sensor acquires the storage 
location memorized in said storage region, A contiguity pixel calculation means 
to compute the contiguity pixel location of the 1st contiguity pixel which adjoins 
the pixel signal which is a pixel signal of the defect pixel memorized in said 
storage location of said storage region, and serves as a processing object in 
said image sensor, A defective judging means to judge whether said 1st 
contiguity pixel is a defect pixel, The defect pixel compensator of the image 
sensor characterized by including an amendment means to amend the pixel 



value of the pixel signal by the defect pixel of said processing object, based on 
the pixel signal memorized in said contiguity pixel location according to the 
judgment result of this defective judging means. 

[Claim 2] Said defective coordinate acquisition means is the defect pixel 
compensator of the image sensor characterized by acquiring the storage 
location in said signal storage means corresponding to said coordinate 
information including a coordinate storage means to memorize the coordinate 
information to which this equipment pinpoints the location of the defect pixel of 
said image sensor in equipment according to claim 1. 

[Claim 3] It is the defect pixel compensator of the image sensor characterized by 
Tdiarrrgh^ equipment indicates said storage location to 

be for said said coordinate information in equipment according to claim 2, and 
having a means to supply this conversion result to said defect pixel coordinate 
acquisition means. 

[Claim 4] Said contiguity pixel calculation means is the defect pixel compensator 
of the image sensor characterized by computing the contiguity pixel location of 
the 1st contiguity pixel which adjoins [ in / on equipment according to claim 1 to 3 
and / said image sensor ] of the same color component. 

[Claim 5] In equipment according to claim 1 to 4 said amendment means The 1st 
pixel value acquisition means which acquires the pixel value of the 1st contiguity 



pixel in said contiguity pixel location, The 1st operation means which computes 
the pixel value which interpolates said object pixel based on the 1st contiguity 
pixel acquired with said 1st pixel value acquisition means, The 2nd operation 
means which computes the pixel value which interpolates said object pixel 
among the contiguity pixels acquired with said pixel value acquisition means 
based on the 1st remaining contiguity pixels except the 1st contiguity pixel 
judged that is a defect pixel with said defective judging means, The defect pixel 
compensator of the image sensor characterized by including the 1st interpolation 
value write-in means which writes the operation value computed with said 1st 
operation means or said 2nd operation means in the storage location of said 
object pixel. 

[Claim 6] It is the defect pixel compensator of the image sensor to which said 1st 
operation means performs the operation which equalizes two or more pixel 
values of the 1st contiguity pixel which adjoin said object pixel in equipment 
according to claim 5, and said 2nd data-processing means is characterized by 
computing the normal average of the 1st contiguity pixel do not judge that is a 
defect pixel with said defective judging means among said 1st contiguity pixel. 
[Claim 7] In equipment according to claim 1 to 4 said defective judging means It 
judges whether the 1st contiguity pixel in said contiguity pixel location is a defect 
pixel. Said contiguity pixel calculation means The contiguity pixel location of the 



2nd contiguity pixel which adjoins the 1st contiguity pixel is computed, if judged 
with said 1st contiguity pixel being a defect pixel with said defective judging 
means - this ~ said amendment means The 1st pixel value acquisition means 
which acquires the pixel value of said 1st contiguity pixel, and the 2nd pixel value 
acquisition means which acquires the pixel value of said 2nd contiguity pixel, 
The 3rd operation means which computes the pixel value which interpolates said 
object pixel based on the pixel value acquired with said 1st pixel value means 
when the 1st contiguity pixel corresponding to said object pixel is normal, The 
2nd interpolation value write-in means which writes the result of an operation 
computed with the 3rd operation means in the storage location of said object 
~pixe11s~inc1^ 

pixel which is judged as either of said 1st contiguity pixel being a defect pixel 
with said defective judging means, and adjoins said 1st contiguity pixel is 
acquired with said 2nd pixel value acquisition means Defect pixel interpolation 
equipment of the image sensor characterized by computing the pixel value 
which interpolates said object pixel based on the pixel value acquired with said 
1st pixel value acquisition means, and the pixel value acquired with said 2nd 
pixel value acquisition means. 

[Claim 8] In equipment according to claim 7 said 3rd operation means If the pixel 
value which interpolates said object pixel by data processing which averages the 



pixel value of the 1st contiguity pixel acquired with said 1st pixel value 
acquisition means is computed and the pixel value of said 2nd contiguity pixel is 
acquired with said 2nd pixel value acquisition means It is the defect pixel 
compensator of the image sensor which computes the average of the normal 
pixel value of the 1st contiguity pixel acquired with said 1st pixel value 
acquisition means, and the pixel value of said 2nd contiguity pixel, and is 
characterized by said 2nd interpolation value write-in means writing said 
calculation result in the storage location of said object pixel. 
[Claim 9] It is the defect pixel compensator o_f the. image sensor characterized by 
equipping this equipment with said image sensor in equipment according to 
"claim 1 to 8. 



DETAILED DESCRIPTION 

[Detailed Description of the Invention] 
[0001] 

[Field of the Invention] This invention relates to the defect pixel compensator of 
the image sensor which amends the pixel signal which originates in the pixel 
defect of a solid state image sensor, and is generated, concerning the defect 



pixel compensator of an image sensor. 
[0002] 

[Description of the Prior Art] For example, the 2-dimensional solid state image 
sensor with which many light-sensitive elements are arranged in the shape of an 
array in a horizontal and the direction of a vertical scanning, and constitute a 
pixel, respectively is known. It originates in the production process etc. and there 
is often that the eel which does not react to incident light, and the eel which 
generates many [ unusually ] dark currents even if there is no incident light are 
contained in the photo detector contained in such an image pick-up eel array. 
These defective eel is difficult to be called a "black crack" and a "white crack", 
respectively—fore^ in 
a solid state image sensor. 

[0003] Then, in the picture signal outputted from a solid state image sensor, the 
amendment method of the defect pixel which amends the pixel signal of the 
defect pixel generated in these defective eels using the pixel signal which can be 
acquired from the image pick-up eel of the perimeter is proposed. When the pixel 
signal of a defective eel was amended, the arithmetic average of the pixel signal 
of two or more image pick-up eels which adjoin the perimeter of the defective eel 
was carried out, and there was a method which transposes the average to the 
pixel signal of the defective eel concerned. 



[0004] 

[Problem(s) to be Solved by the Invention] However, when a defective eel 
adjoined, for example and there were two or more defective eels in the shape of 
a burst by the above amendment methods, the average which will equalize using 
the contiguity pixel value of other defective eels which adjoin the defective eel 
used as a processing object, and was computed was not suitable to replace as a 
value of an object pixel. Moreover, in order to amend the defective eel of further 
others, when the pixel value computed by doing in this way was used as a 
contiguity pixel, an amendment error_was not able to accumulate to the 
processing result, and suitable defective amendment was not able to be 
performed. 

[0005] This invention cancels the fault of such a conventional technique, and 
even if it is the case where two or more defective eels used as a defect pixel 
have occurred continuously, it aims at offering the defect pixel compensator of 
the image sensor which can amend the value of the defect pixel appropriately. 
[0006] 

[Means for Solving the Problem] In the defect pixel compensator of the image 
sensor which inputs the pixel signal outputted from an image sensor, and 
amends the defect pixel value of the pixel signal by the defect pixel in an image 
sensor in order that this invention may solve an above-mentioned technical 



problem A signal storage means by which this equipment memorizes a pixel 
signal to a predetermined storage region, A defective coordinate acquisition 
means by which the pixel signal corresponding to the defect pixel in an image 
sensor acquires the storage location memorized in the storage region, A 
contiguity pixel calculation means to compute the contiguity pixel location of the 
1st contiguity pixel which adjoins the pixel signal which is a pixel signal of the 
defect pixel memorized in the storage location of a storage region, and serves as 
a processing object in an image sensor, It is characterized by including a 
defective judging meansjojudge whether thejst contiguity„.pixel is a defect pixel, 
and an amendment means to amend the pixel value of the pixel signal by the 
ijef^l^xel^f^^oce^ the 
contiguity pixel location according to the judgment result of a defective judging 
means. 
[0007] 

[Embodiment of the Invention] Next, one example of the image pick-up 
equipment with which the defect pixel compensator of the image sensor by this 
invention was applied with reference to the accompanying drawing is explained 
to a detail. When drawing 1 is referred to, it is image pick-up equipment which 
records the data which the block diagram of a digital camera is shown as one 
example to which this invention was applied, and this digital camera 10 



processes the image pick-up signal of the field picturized by non-illustrated an 
image pick-up lens and an image sensor 12, and express a static image on a 
body 10 at the removable memory card 30. In detail, it has the still picture mode 
which a camera 10 carries out still picture coding processing of the image 
pick-up image of high resolution, and is recorded on a memory card 30, and a 
cine mode for performing framing etc. in the case of photography, and if the 
release switch with which the control unit 26 was equipped is operated by the 
ON state, still picture mode will be set up. Moreover, in a cine mode, 
photography and image pick-up accommodation of framing which checks the 
monitor display which displays the picturized dynamic image by looking, and 
"performs it, focus adjustment, exposure adjustment, etc. are performed. If it 
shifts to still picture mode according to the release actuation by the photography 
person, a camera 10 will be recorded on the memory card 30 with which 
processes the high resolving static image of one coma picturized after framing is 
carried out in a cine mode, or two or more coma, and the output section 24 is 
loaded free [ attachment and detachment ]. Especially this camera 10 is image 
pick-up equipment to which amend appropriately the defect pixe[generated with 
an image sensor 12, and a good image is made to output. In addition, the part 
which does not have the direct relation to this invention in the following 
explanation omits illustration and its explanation, and the reference mark of a 



signal is expressed with the reference number of the appearing path cord. 
[0008] A camera 10 is equipped with the image sensor 12 which changes into an 
electrical signal the field image by which image formation is carried out with the 
image pick-up lens arranged towards a field. An image sensor 12 The 
photodiode which forms two or more pixels in the horizontal and the direction of 
a vertical scanning which constitute a screen, respectively Level and the 
sensitization section arranged perpendicularly, [ two or more ] the charge 
generated with each photodiode - perpendicular (V) Perpendicular transfer 
CCD transmitted to_a„directjpn_ each perpendicular Jransfer_CCQ_ _from_ — the 
charge transmitted - horizontal (H) Level transfer CCD transmitted to a direction 
twel'transferXCD^^ the 
output amplifier which changes and outputs the charge transmitted to an 
electrical signal. 

[0009] That manufacture top defect pixel is contained in this image sensor 12, 
and a pixel with larger flaw level than that of other normal pixels is dealt with as a 
defect pixel with extent of that defect to it. the coordinate data which pinpoints 
the location of a defect pixel is supplied from the manufacture manufacturer of 
an image sensor 12 - having — the control section (CPU) of the after-mentioned 
[ this coordinate data ] -- it is stored in the coordinate memory 28 connected to 
22. In case not only this but the image sensor 12 is built into this camera 10, a 



defect pixel may be distinguished uniquely, and the coordinate data in which the 
location is shown may be created in the coordinate memory 28. 
[0010] an image sensor 12 — input 100 the electrical signal drive following tha 
driving signal inputted, generate the charge according to the amount of the light 
which reaches a photodiode, and its exposure time, respectively, and 
corresponding to the charge — RGB a dot order - as the following image pick-up 
signal — output 102 It outputs. The image sensor 12 in this example is the driving 
signal 100 supplied in a cine mode. It follows and is each pixel to level and a 
perpendicular direction One half It culls put and is every direction 640x460 in 
which a monitor display is possible. RGB of a pixel It is an output 102 about the 
-dynamic-image signal whic^^ frame from 

the 2 fields. It outputs. Moreover, RGB whose effective pixel all pixel read-out is 
performed in still picture mode, and is 1280x1024 pixels of every direction A 
pixel signal is outputted for every frame. 

[0011] The pixel value acquired in the sensitization section corresponding to the 
location registered into the coordinate memory 28 as a defect pixel among the 
pixel signals outputted from such an image sensor 12 is amended in the 
digital-signal-processing section 20 mentioned later. When an image sensor 12 
is the image pickup device which picturizes the so-called monochrome image, 
this amendment processing As a part of pixel array of an image sensor is shown 



in drawing 3 , it is a pixel location in an image sensor (H, V). Inside, Pixel (2 3) 
Pixel which is a defect pixel and adjoins this pixel (3 3) When it is a defect pixel, 
by the 1st amendment method A contiguity pixel (2 2) and (1 3) (2 4), The pixel 
value acquired from three pixels is used, and it is an object pixel (2 3). A pixel 
value is amended. In this case, it is a contiguity pixel (3 3) temporarily. In not 
being a defect pixel, it usually passes, and it is a contiguity pixel (2 2), and (1, 3) 
(2 4), Contiguity pixel (3 3) Object pixel which should perform defective 
amendment using each applied pixel value (2 3) A pixel value is amended. 
When ther e is no d efect pixeL around the defect pixel used as the candidate for 
amendment, this 1st amendment method equalizes 4 pixels of circumferences of 
~thB^arget~defect^ 

value of an object pixel to that result of an operation. However, when the defect 
pixel adjoins in the shape of a burst, the pixel value of a defect pixel is amended 
using 3 pixels of normal contiguity which adjoins around the defect pixel used as 
the candidate for amendment, without using the defect pixel which adjoined. In 
this case, you may make it use 2 pixels of circumferences which adjoin an object 
pixel, and 1 pixel. 

[0012] Moreover, as shown to drawing 4 in the 2nd amendment method, for 
example, it is an object pixel for defective amendment (2 3). Contiguity pixel 
which adjoins (3 3) It is a defect pixel. Object pixel (2 3) When amending a pixel 



value, it is a contiguity pixel (3 3). 4 The contiguity pixel (3 2) and (3) (3 4) which 
adjoin further, the pixel value acquired from one of one pixels inside, The 
contiguity pixel (2 2) of an object pixel, and (1 3) (2 4), Four pixel values with 
each pixel value are used, and it is an object pixel (2 3). A pixel value is 
amended. In this case, data processing which takes a 4-pixel average when the 
defect pixel exists independently, and amends a defect pixel can be used as it is. 
Since 4 pixels which adjoins an object pixel were equalized and the average 
result was made into the pixel value of an object pixel, even if it was the case 
where the pixel which adjoins a defective object was also a defect pixel 
according to the conventional amendment method, as shown in drawing 5 , 
■nMthoogtrnt^H 

observation of defect pixel data when continuation arrangement of the defect 
pixel was carried out In the example of an above-mentioned all directions type, 
in case such a continuous defect pixel is amended, since it is made not to use 
the contiguity pixel registered as a defect pixel, suitable defect pixel amendment 
can be performed. Such pixel defective amendment is suitably applied, not only 
a monochrome camera but when amending the defect pixel generated with each 
image sensor with which the image pick-up unit of the multi-plate type which 
carries out the spectrum of the incident light to for example, RGB each primary 
color according to color-separation optical system, such as dike lock prism, and 



receives each primary color component by which the spectrum was carried out is 
equipped. 

[0013] The above explains below the case where an image sensor 12 is the 
so-called veneer type color image sensor, although a fundamental amendment 
method in case the image sensor 12 of one unit is a monochrome image pickup 
device is explained. In this case, in the sensitization section which constitutes 
each pixel of an image sensor 12, it is RGB. The primary color color filter and the 
complementary filter are put. For example, as that part is shown in drawing 6 as 
an example, this image sensor 1 2 is an image sensor on which the primary color 
filter of a G stripe R/B perfect check array is put. When amending the defect pixel 
"irrthenmage-sensor-o^^ 

whether the pixels which adjoin of the same color component, respectively are 
defect pixels continuously to amend the pixel for amendment only paying 
attention to the respectively same color component is determined. Pixel which is 
a defect pixel in the image sensor of the filter array shown in this drawing (4 5) In 
case it considers as the pixel for amendment and the pixel value is amended (6 
The contiguity pixel (4 4) which adjoins this object pixel of the same color 
component, (2, 5), 5) (4 6), When 4 pixels is a normal pixel, the pixel value of 
these 4 pixels is equalized and processing which replaces that result of an 
operation as a pixel value of a pixel (4 5) is performed. However, object pixel (4 



5) Contiguity pixel of the same color component (6 5) When it is a defect pixel, it 
is this contiguity pixel (6 5). It is not used but a pixel value is other contiguity 
pixels (4 4), and (2, 5) (4 6), Object pixel (4 5) It is used as a contiguity pixel to 
amend. This situation is shown in drawing 6 . Namely, pixel (4 5) (6 5), Pixel 
which is a defect pixel when it is a defect pixel, respectively (6 5) 2 The pixel (4 
4) and (5) (4 6) which were excepted and which remain, The average of three 
pixel values is computed and it is a pixel (4 5) about the calculation result. 
Processing replaced as a pixel value is performed. This is fundamentally [ as the 
1st above-mentioned amendment method ] the same. 

[0014] Moreover, the 2nd amendment method of the defective amendment 
processing to a veneer type color image sensor is explained with reference to 
drawing 7 . It is a pixel (4 5) like above-mentioned explanation (6 5), It is a defect 
pixel and is a pixel (4 5). In amending as a pixel for amendment A contiguity pixel 
(4 4) and (2 5) (4 6), It adds to a pixel and is a contiguity defect pixel (6 5). 8 The 
pixel (6 4) and (5) (6 6) which adjoin in the same color further, One of pixels is 
used. 4 For example, (a pixel (4 4), (2, 5), 6) (6 6), It is a pixel (4 5) about the 
average. The value is replaced as a pixel value. In this case, the same data 
processing as usual is employable as that equalization data processing like the 
example shown in drawing 4 . That is, a pixel value average can be computed by 
the ability to do the division of the sum total of four pixel values by the several 4. 



In this case, it is good to use a contiguity pixel with a short distance between 
pixels of an object pixel and the contiguity pixel which adjoins in the same color. 
Moreover, the weight according to the distance of„an object pixel and a 
contiguity pixel may be set up, and you may equalize so that weight may be put 
on a near contiguity pixel by the object pixel. Moreover, at the example shown in 
drawing 7 , it is a contiguity pixel (6 5). Although one of pixels was used among 
the pixels which replace with and adjoin the pan, it is a pixel (6 4), and not only 
this but (8, 5) (6 6), It is a contiguity pixel (6 5) about the average of inside 2 
thru/or three pixels. You may use as a pixel value to replace. 
[0015] As shown, for example in drawing 8 by the conventional approach, it is an 
~object~pixel~(4 5)7ContigiJity~pix~eT^ 

5) Even if it is the case where it is a defect pixel even if Object pixel (4 5) The 
average of 4 pixels of the contiguity pixel which adjoins of the same color 
component was computed simply, and although interpolation processing which 
makes this calculation result the pixel value of an object pixel was performed, 
since the pixel value of a defect pixel was used in this case, the value of the 
interpolated object pixel had turned into superfluous correction value. However, 
in the 1st and 2nd interpolation arts shown in drawing 3 and drawing 4 , since the 
suitable contiguity pixel which does not use the contiguity defect pixel, but 
switches the operation approach, and amends an object pixel, and is replaced 



with a contiguity defect pixel is chosen and the same data processing as usual 
amends the pixel for interpolation when a contiguity pixel is a defect pixel, a 
good amendment result is obtained. 

[0016] As mentioned above, although the method which amends a defect pixel 
was explained based on the pixel array and filter array on an image sensor 12, 
the processing is performed in the digital-signal-processing section 20 which 
explains such defect pixel amendment processing below. In the following 
explanation, the image sensor 12 with which it has the above-mentioned color 
filter shall be used. 

[0017] drawing 1 - returning ~ output 102 of an image sensor 12 **** - the 
"picture" s1gnaTwith~wfflch therpixel value acquired from to 
the individual difference of the image sensor is included is outputted. This output 
102 It is the correlation duplex sampling (CDS) which connects with the analog 
processing section 16 and carries out a correlation duplex sampling 
synchronizing with the pixel clock to which the analog signal with which the 
analog processing section 16 is outputted from an image sensor 12 is supplied 
from the timing control section 14. It has a circuit. A correlation duplex sampling 
circuit is the image pick-up signal 102 inputted. The reset noise which can be set 
is removed. Furthermore, the analog processing section 16 is RGB. The color 
separation circuit separated three lines for every color component following the 



color separation pulse to which the image pick-up signal inputted into point 
sequential is supplied from the timing control section 14, The color balance 
equalization circuit and gamma correction circuit which adjust the level of each 
color component signal by which color separation was carried out, Control 
signals 104 inputted including the multiplexer which line-izes each color 
component signal formed into 3 lines, such as a pixel clock and a color 
separation pulse It follows and analog signal processing of these adjustments, 
amendment processing, etc. is performed. The analog processing section 16 is 
each RGB which carried out front-end interpolation of the defect pixel. Output 
106 after switching a color component and line-izing a signal for every 1 
horizontal-scann^ is 
supplied line sequential. 

[0018] A/D A transducer 18 is an input 106. It is the analog-to-digital-conversion 
processing section which changes the picture signal inputted into the digital 
signal of a predetermined bit. A/D in this example A transducer 18 is A/D 
supplied from the timing control section 14. Control signals 108, such as a clock 
and a synchronizing signal It follows and sequential conversion of each pixel 
signal of each color component switched and supplied for every horizontal 
scanning period is carried out at the digital value of 8 bits or 10 bits. A/D Output 
110 of the transform-processing section 18 It connects with the 



digital-signal-processing section 20. 

[0019] The digital-signal-processing section 20 is the digital image data 110 
inputted. Control signal 112 from a control section 22 It is based and is the 
processing circuit which carries out various digital signal processing. This 
signal-processing section 20 is RGB. If it has the frame memory (FM) 21 which 
stores a picture signal temporarily, respectively and still picture mode is set up, 
amendment processing which amends color balance, brightness, saturation, etc. 
will be performed to the image data stored in a frame memory 21 according to 
the signal-processing parameter according to still picture mode. Moreover, the 
signal-processing section 20 has the processing facility which performs digital 
signarproce^B^ tolmage 
data, and creates a suitable static image. Moreover, in still picture mode, the 
digital-signal-processing section 20 has YC separation processing facility which 
changes RGB primary color color picture data into the brightness data Y and the 
color difference data C, and when displaying an image pick-up image on a 
general-purpose external indicating equipment in a cine mode, it supplies YC 
data which performed YC transform processing to the output section 24. 
Moreover, the signal-processing section 20 supplies RGB image data to the 
output section 24, when displaying an image pick-up image on the liquid crystal 
display monitor equipment built in the output section 24. Moreover, according to 



the compression coding method processed in the output section 24, the 
signal-processing section 20 in still picture mode changes image data into YC 
data, and supplies it to the output section 24. 

[0020] Moreover, the digital-signal-processing section 20 embraces the filter 
array of an image sensor 12, and is three primary colors RGB about each pixel. 
R, G, and B RGB in the pixel of each primary color to one pixel location It has the 
pixel generation function which generates each pixel by interpolation processing, 
respectively. [ in / it has the pixel interpolation function to express and / an image 
sensor 12 ] 

[0021] Furthermore, before the digital-signal-processing section 20 performs 
~above"mentioned~^ the" function which 

amends the defect pixel generated with an image sensor 12, and generates the 
static image amended good by using two or more pixels of the circumference of 
a defect pixel in that case, and carrying out interpolation processing at it. In detail, 
the signal-processing section 20 is the positional information 114 supplied from 
a control section 22 according to the coordinate data of the defect pixel stored in 
the coordinate memory 28 mentioned later. It uses and interpolation processing 
which replaces the value of the defect pixel contained in an image pick-up signal 
with the value according to the contiguity pixel value of the same color 
component is performed. For example, the signal-processing section 20 



computes those averages using the same color component pixel of the direction 
of four directions which approaches a defect pixel among the image data once 
memorized by the frame memory 21, and performs interpolation processing 
which writes the average in the address with which a defect pixel is memorized, 
and returns a defect pixel. The signal-processing section 20 reads the 
static-image data of one coma which did in this way and performed various 
picture signal processings after defective amendment processing from a frame 
memory 21, and is an output 116. It outputs to the connected output section 24. 
[0022] In case the digital-signal-processing section 20 in this example processes 
a defect pixel, and it interpolates the pixel for interpolation, it has the functional 
conf igufa t io rn which Tea I izes~t he "1 st~ a i bo ve^me n t i o~n~ed~a mend menT~meth'od so 
that good pixel defective amendment may be performed according to the 
condition of a required contiguity pixel, even if it is the case where a contiguity 
pixel is a defect pixel. When the functional configuration of the signal-processing 
section 20 which performs such defective amendment is shown in drawing 2 , 
the signal-processing section 20 positional information 114 of the defect pixel 
supplied from a control section 22 The defective coordinate acquisition section 
200 to acquire the adjoining address calculation section 202 which computes the 
memory address in the frame memory 21 of the contiguity pixel which adjoins 
the defect pixel of a processing object of the same color component the 



defective judging section 204 which judges whether the contiguity pixel is a 
defect pixel based on said memory address, and outputs the judgment result 
The delay section 206 which once memorizes the pixel address, and is delayed 
and outputted after time amount predetermined [ according to pixel value 
acquisition timing ] Defective judging section 204 The interpolation processing 
section 208 which performs interpolation processing according to a judgment 
result It contains. 

[0023] As shown in this drawing, it is the interpolation processing section 208. It 
is the defective judging section 204 further. The pixel value acquisition section 
210 which acquires the pixel value of a normal contiguity pixel from a frame 
memory 21 according to a defective judging, the defective judging section 204 
the case where it is judged with four contiguity pixels being normal pixels, 
respectively - the pixel value acquisition section 210 The 1st data-processing 
section 212 which performs a four-point interpolation operation using four pixel 
values by which sequential acquisition is carried out Defective judging section 
204 When a judgment result has one defect pixel contained, it is the pixel value 
acquisition section 210. The 2nd data-processing section 214 which performs a 
three-point interpolation operation using three pixel values by which sequential 
acquisition is carried out, The 1st data-processing section 212 And the 2nd 
data-processing section 214 The interpolation value write-in section 216 which 



writes the computed pixel value in the memory address of a interpolation 
processing-object pixel, and returns the interpolation result of an operation to a 
frame memory 21 It has. 

[0024] Interpolation processing section 208 For every defect pixel of the object 
according to the defective coordinate address, it judges whether the contiguity 
pixel is a defect pixel, and the value of the remaining normal pixels which 
excepted the defect pixel is used, that time - the 1st data-processing section 
212 **** ~ among contiguity pixels, when all are normal 4 pixels, data processing 
which arithmetic-average-izes four pixel values is performed. 
[0025] Moreover, it will be started if judged with one pixel being a defect among 
contiguitynpixels in^he~2rrd^ara^rocessing section7"and~iris the pixel value 
acquisition section 210. Data processing which equalizes the value of three 
normal pixels by which sequential acquisition is carried out is performed. In 
addition, the 2nd data-processing section 214 The 1st data-processing section is 
the pixel value acquisition section 210 without preparing. About two or more 
normal pixel values acquired, it is the defective judging section 204. It may be 
constituted so that the parameter which does a division according to a result 
may be changed, the interpolation value write-in section 216 the case where the 
result of an operation is supplied only from the 1st data-processing section 212 
at every interpolation data processing to an object pixel - the operation value — 



the delay section 206 from - it writes in the memory address given and the pixel 
value of the object pixel memorized by the frame memory 21 is updated, 
moreover, the interpolation value write-in section 216 the case where the result 
of an operation is supplied from the 2nd data-processing section -- the operation 
value - the delay section 206 from — it writes in the memory address given and 
the pixel value of the object pixel memorized by the frame memory 21 is updated. 
Thus, when a pixel value is updated, it is the interpolation value write-in section 
216. It is the defect pixel acquisition section 200 about the control signal for 
amending the following defect pixel. Delivery and the defect pixel acquisition 
section 200 Positional information 114 of a defect pixel unsettled from the 
coordinat^Tri^^ry~28~^ 

amendment processing to the following defect pixel. 

[0026] Thus, the pixel defective amendment function in the 
digital-signal-processing section 20 in this example As opposed to the memory 
address of the defect pixel supplied from a control section 22 among the image 
data stored in the frame memory In case the storage value is amended, when 
the contiguity pixel used for amendment is the value acquired from the defect 
pixel again, the pixel value acquired from the normal contiguity pixel which 
remains is equalized without using the contiguity pixel, and it is constituted so 
that the average may be updated as a pixel value of an object defect pixel. 



Therefore, in case a defect pixel value is amended, performing superfluous 
amendment with an unusual pixel value is prevented. 

[0027] The digital-signal-processing section 20 reads the image data by which 
did in this way, performed amendment processing of a defect pixel, performed 
amendment processing, YC transform processing, etc., such as pixel generation 
processing further mentioned above, and color balance, brightness, saturation, 
did in this way, and amendment and adjustment processing were carried out 
good from a frame memory 21 , and supplies to the output section 24. 
[0028] The output section 24 is the processing section to which the image data 
processed in the digital-signal-processing section 20 is made to output with a 

indicating equipment which displays the image and image which image data 
expresses, and is an input 116. The image of each coma according to the RGB 
image data inputted is displayed on the display screen. Moreover, the output 
section 24 is image data 116. It changes into an NTSC video signal, for example, 
and is the output 118. It outputs to general-purpose visual equipments, such as 
television monitor equipment connected free [ attachment and detachment ], and 
a video printer, a videocassette recorder. Furthermore, the output section 24 is 
an output 120 about the coded data processed by the data of predetermined 
length by carrying out compression coding for example, with the JPEG method 



in YC image data of the static image obtained by still picture photography. The 
storages 30, such as a memory card connected free [ attachment and 
detachment ], are made to memorize. The output section 24 has the function 
which reads the information recorded on the storage 30 again, decodes the 
coded data, and supplies the decoded image data to the 
digital-signal-processing section 20. In this case, the signal-processing section 
20 carries out reconversion processing of the image data supplied from the 
output section 24 at the signal format according to the output destination change 
from thejout put section _24, and is an output 116 about that processing result. It 
outputs. In addition, the digital-signal-processing section 20 is good to change 
"into~the~predetermined~format _ acc"ord an 
input/output terminal, when it has the serial input/output terminal or parallel 
input/output terminal of each coma which may be equipped with the digital 
terminal which outputs and inputs a digital image signal, for example, continues 
which can output and input dynamic-image data. 

[0029] A control section 22 sets up a cine mode and still picture mode 
alternatively according to an operator's actuation condition over a control unit 26, 
and has the function which controls each part according to the mode. In detail, a 
control section 22 will set up a cine mode, if a power source is supplied to this 
camera 10, and if release ** arranged at the control unit 26 is pushed, it will set 



up still picture mode. In addition, when the release switch of a control unit 26 
consists of two-step type switches, it is good to perform the display process of 
the image pick-up accommodation in a cine mode, and its image pick-up image 
by the 1st stroke, to adjust a focus, exposure accommodation, a white balance, 
etc., and for a release switch to shift to still picture mode in the 2nd stroke 
pushed further. 

[0030] If a cine mode is set up by the control section 22, the timing control 
section 14 will generate the driving signal which thins out an image sensor 14, 
and.reads_and drives it.Jn_still picture mode^a^controLsectign 22_changes into 
the memory address of a frame memory 21 the coordinate data recorded on the 
coordi nate - memory ~287~g i ves~~the~" positiona I ~inf ormatio n~ acq u i red™ by th is 
conversion to the digital-signal-processing section 20, and has the function to 
specify the memory address of each defect pixel in the frame memory 21 of the 
signal-processing section 20. 

[0031] In addition, in this example, the coordinate data in which the position 
coordinate of a pixel defect is shown is stored in the coordinate memory 28, and 
pixel defective amendment processing is performed in still picture mode to the 
pixel corresponding to the coordinate data. However, it may be not only this but 
a cine mode, or may be a cine mode in the case where the processing speed of 
a defect pixel is earlier than the transfer rate of the animation signal, or the same 



data processing as still picture mode may be performed. In performing a cine 
mode display in this cine mode, the indicating equipment which is that output 
destination change is made to suit, pixel infanticide of image data is performed, 
and it changes image size. In this case, when the pixel thinned out is a defect 
pixel even if, an operation load is reduced by not making that pixel into an object 
pixel. In such a case, it may have and the defective coordinate data from which 
the defect pixel which does not serve as a processing object in a cine mode was 
excepted may be independently stored in the coordinate memory 28. 
[0032] Next, the digitaJ : signal-processina section to which .the 2nd_a_mendment 
method mentioned above was applied is explained below. The 
THg1t3rf=5igna^ "showrri n ~d ra wi n rg~97 ~th is~exa m p 1e ~] 900 

It replaces with the digital-signal-processing section 20 shown in drawing 1 , 
prepares for a digital camera 10, and has the function which carries out 
amendment processing of the pixel value of the defect pixel in an image sensor 
12 like the above-mentioned example. In addition, the digital-signal-processing 
section 900 About each functional configuration other than defect pixel 
amendment, it has the various signal-processing functions in the 
above-mentioned example. 

[0033] The signal-processing section 900 in this example It has the configuration 
for amending the pixel value of the defect pixel which should be amended using 



the 2nd contiguity pixel which is used in case interpolation processing of a defect 
pixel is performed, the candidate for interpolation is adjoined and the defect pixel 
value is amended, and adjoins further the contiguity pixel which is the defect 
pixel when a ******** contiguity pixel is a defect pixel, detailed - the 
signal-processing section 900 Coordinate data 114 in which the memory 
address in the frame memory 21 of the defect pixel used as a processing object 
is shown The defective coordinate acquisition section 200 acquired from a 
control section 22 the adjoining address calculation section 902 which computes 
the memory address of the contiguity pixel which adjoins the defect pixel of a 
processing object of the same color component Adjoining address calculation 
section 902 The memory address of The computed contiguity pixel the defective 
coordinate acquisition section 200 Acquired positional information 114 The 
defective judging section 904 judge whether it is contained or not to be and the 
pixel in the memory address judges whether it is a defect pixel to be the delay 
section 206 which once memorizes the pixel address and is outputted after time 
amount predetermined [ according to pixel value acquisition timing ] Adjoining 
address calculation section 902 And the defective judging section 904 The 
interpolation processing section 906 which amends the defect pixel value of an 
object pixel based on the memory address supplied It has. 
[0034] The adjoining address calculation section 902 in this example Defective 



judging section 904 The judgment result of the defect pixel which can be set is 
followed and it is the interpolation processing section 906 about the memory 
address of a normal contiguity pixel. The inner 1st pixel value acquisition section 
908 It supplies, and the memory address of the contiguity pixel which is a defect 
pixel is constituted so that it may not output. Moreover, the adjoining address 
calculation section 902 The contiguity pixel which adjoins the object pixel in case 
the defect pixel of an object pixel is amended is the defective judging section 904. 
When it is a defect pixel as a result of a judgment, it has the data-processing 
— function which computesthe memory address of the-2nd contiguity pixel which 
adjoins the pixel further. Defective judging section 904 It is the interpolation 
processing section 906 about the memory address of the 2nd computed 
contiguity pixel. The 2nd pixel value acquisition section 910 It supplies. 
[0035] the interpolation processing section 906 in this example further — the 
adjoining address calculation section 902 The 1st pixel value acquisition section 
908 which reads the pixel value memorized by the memory address of the 
computed contiguity pixel from a frame memory 21 the defective judging section 
904 The 2nd pixel value acquisition section 910 which reads^the pixel value 
memorized by the memory address of the 2nd contiguity pixel supplied from a 
frame memory 21 The 1st pixel value acquisition section 908 It is based on the 
pixel value of 4 pixels of acquired contiguity, the data-processing section 912 



which computes the interpolation pixel value of an object pixel by equalization 
data processing it is - the 2nd pixel value acquisition section 910 from, if the 
pixel value of the 2nd contiguity pixel is supplied the 1st pixel value acquisition - 
section 908 Three normal pixels and 2nd pixel value acquisition sections 910 
which were acquired The data-processing section 912 which computes the 
interpolation pixel value of an object pixel by carrying out equalization data 
processing of each pixel value of 4 pixels which totaled the acquired 1 -pixel pixel 
Data-processing section 912 The interpolation value write-in section 914 which 
writes the result of an operation which can be set in the memory address of the 
object pixel sent from the delay section 206 as a pixel value which interpolates 
an object pixel, and updates the defect pixel value on a frame memory 21 It has. 
[0036] Defective amendment processing by 4-pixel average can be performed 
by carrying out equalization processing of the pixel value of the contiguity pixel 
which has recognized the contiguity pixel replaced with the contiguity recognized 
in the 1st step in the 2nd step, and has been recognized in each phase like the 
usual case, without changing data processing which equalizes the pixel value of 
two or more contiguity pixels by this example by such configuration. In this case, 
you may make it calculate the interpolation value over an object pixel by 
computing these averages by calculating the average of the 2nd contiguity pixel 
which adjoins the pan of that pixel in the value replaced with the 1st contiguity 



pixel, and using this value and the normal contiguity pixel of the beginning to an 
object pixel. 

[0037] As explained above, in case the value of the contiguity pixel which adjoins 
the pixel amends the value of the pixel for interpolation which is a defect pixel, it 
recognizes whether a contiguity pixel is a defect pixel. Since the pixel is 
excepted, and it is constituted based on the value of the normal contiguity pixel 
which remains so that the pixel value of the pixel for interpolation may be 
calculated when a contiguity pixel is a defect pixel, interpolation processing 
which does not receive the effect by the defect of a -contiguity pixel in the 
interpolation result is performed. Consequently, in interpolation processing of a 
defect pixel, it is prevented that defective amendment turns into superfluous 
amendment and image quality deteriorates by the processing result, moreover, 
in constituting so that it may recognize whether a contiguity pixel is a defect pixel 
further While not using the contiguity pixel value which is the defect pixel for 
amendment processing Since either of the 2nd contiguity pixel which adjoins the 
defective contiguity pixel further, and the normal contiguity pixel of an object 
pixel are used and the interpolation pixel value about an^ obje ct J^jxel is 
calculated, even if it is the case where the defect pixel has occurred in the shape 
of a burst, it is prevented that interpolation precision falls sharply. 
[0038] In addition, although it consisted of each above-mentioned example so 



that the adjoining address might be computed whenever it amended the pixel 
defect This invention stores beforehand in the storage means of coordinate 
memory 28 grade not only this but the memory address which shows the 
contiguity pixel used for example, by defective amendment. The memory 
address of these defect pixels, The memory address of the contiguity pixel 
corresponding to this is read from a storage means, and the 
digital-signal-processing section 20 and a storage means may be constituted so 
that it may be used for interpolation data processing. 
[0039] 

[Effect of the Invention] Thus, it judges whether a contiguity pixel required in 
case the defect pixel in an image sensor is amended according to this invention, 
and an object pixel is interpolated is a defect pixel. Since the pixel value of an 
object pixel is computed based on the pixel value which recognizes data 
processing according to the judgment result, or the 2nd contiguity pixel replaced 
with the contiguity defect pixel, and is acquired from the normal pixel which are 
not these defect pixels Suitable amendment can be performed without replacing 
with superfluous correction value to the defect pixel of a processing object. 
Consequently, the bad influence to the image pick-up image by the defect pixel 
of an image sensor can be appropriately reduced to removal or large width of 
face. Thus, even if it is the case where two or more defective eels used as a 



defect pixel have occurred continuously, the value of the defect pixel can be 
amended appropriately and a good amendment image can be obtained. 



DESCRIPTION OF DRAWINGS 
[Brief Description of the Drawings] 

[Drawing 1] It is the block diagram showing one example which applied the pixel 
defective compensator of the image sensor by this invention to image pick-up 
equipments, such as a digital camera. 

[Drawing~2] ^lt""is~the~'brcrck~diagram showing" the~example~ of" an internal 
configuration of the digital-signal-processing section in the example shown in 
drawing 1 . 

[Drawing 3] It is drawing showing the 1st [ to the defect pixel of an image 
sensor ] defective amendment method. 

[Drawing 4] It is drawing showing the 2nd [ to the defect pixel of an image 
sensor ] defective amendment method. 

[Drawing 5] It is drawing showing the conventional example of defective 
amendment. 

[Drawing 6] It is drawing showing the example of amendment at the time of 



applying the 1st defective amendment method to a color image sensor. 
[Drawing 7] It is drawing showing the example of amendment at the time of 
applying the 2nd defective amendment method to a color image sensor. 
[Drawing 8] It is drawing showing the conventional example of amendment over 
a color image sensor. 

[Drawing 9] It is the block diagram showing other examples of an internal 

configuration of the digital-signal-processing section. 

[Description of Notations] 

10 Digital Camera 

12 Image Sensor 

14 Timing Control Section 

20 Digital-Signal-Processing Section 

21 Frame Memory (FM) 

22 Control Section (CPU) 
28 Coordinate Memory 

200 Defective Coordinate Acquisition Section 



